AD-A229  401 


REPRESENTATIONS  IN  MENTAL  MODELS 
(FINAL  REPORT) 

1990 


S 


Investigator: 

(617)  253-5776 
WHIT@EGO.MIT.EDU 
Contract  No.  90-0177 


"%T  1C 
J  1  !U 

ELECTS  |p 

NOV  16 1990 1 


BUC  FILE  COPY 


Whitman  Richards  E10-120 
Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139 


Abstact:  On  March  12-13  an  interdisciplinary  group  of  thirty-five, composed  of  computer 
scientists,  experimental  psychologists,  linguists  philosophers  and  “^connectionists*  met  to 
share  views  on  representations  and  their  role  in  Rental  models.  Although  at  least  two  books 
and  several  papers  directly  address  these  issuers,  the  nature  of  mental  models  is  far  from 
clear.  The  meeting  shed  some  light  on  why  ^understanding”  mental  models  is  difficult. 
Simply  put,  the  reason  is  that  mental  processes  are  described  in  many  different  ways  and 
at  quite  different  levels  of  abstraction,  depending  upon  the  researcher.  For  example,  some 
emphasize  the  cognitive  properties  of  mental  models,  whereas  others  are  more  concerned 
with  the  internal  data  structures.  Still  others  may  stress  the  logical  form  and  content  of  the 
mental  process,  as  contrasted  with  the  actual  computational  machinery.  The  diversity  of 
these  viewpoints  is  clear  upon  reading  the  abstracts  prepared  by  the  participants.  Further 
study  is  needed  to  examine  how  these  diverge  viewpoints  fit  together  into  a  useful,  integrated 
framework^  ') 
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1.0  Overview 

On  March  12-13,  an  interdisciplinary  group  of  thirty-five,  composed  of  com¬ 
puter  scientists,  experimental  psychologists,  linguists,  philosophers  and  “connec- 
tionists”  met  to  share  views  on  representations  and  their  role  in  mental  models. 
The  meeting  was  held  at  the  American  Academy  of  Arts  and  Sciences  in  Cam¬ 
bridge,  Mass.,  under  the  sponsorship  of  the  AFOSR.  Although  at  least  two  books 
and  several  papers  directly  address  these  issues1,  the  nature  of  mental  models 
and  their  representations  is  far  from  clear.  The  meeting  shed  some  light  on  why 
understanding  “mental  models”  is  difficult.  At  the  same  time  some  insight  was 
obtained  as  to  why  the  Cognitive  Sciences  have  had  difficulty  in  developing  an 
integrated,  focussed  discipline  typical  of  the  older  Natural  Sciences  or  of  the  more 
recently  formed  Neurosciences. 


The  Problem  for  Consideration 

“There  is  a  strong  intuition  that  there  are  at  least  two  quite  different  types  of 
representations  in  cognitive  systems,  one  ‘iconic*  based  upon  pictures  and  the 
other  ‘symbolic’  based  upon  links  among  symbols.  (Distributed,  connectionist 
representations  might  be  still  another  form.)  Pictures  seem  more  suitable  for 
geometric  or  spatial  reasoning;  whereas  the  symbolic,  language-like  form  is  com¬ 
mon  in  language  and  reasoning  where  quantification  is  important.  A  ‘Mental 
Model’  may  use  one  or  both  forms,  or  perhaps  still  another.  What  is  the  role  of 
such  representations  in  the  functioning  of  mental  models?” 

The  above  statement  was  posed  to  all  participants,  who  were  required  to 
submit  an  abstract  of  their  view  of  the  role  of  representations  in  mental  models. 
Prior  to  the  meeting,  the  abstracts  were  circulated  to  all  to  accelerate  inter¬ 
changes.  (These  abstracts  are  appended.)  The  meeting  then  began  with  three 
tutorial-like  presentations  of  different  types  of  representations,  followed  by  case 
studies  which  were  designed  to  contrast  the  use  of  quite  different  representations 
in  supporting  the  same  type  of  problem.  For  example  in  one  reasoning  session, 
Erik  Sandewall’s  more  sentential,  logic  approach  was  contrasted  with  Bernard 
Meltzer’s  analog  or  iconic  reasoning  with  “pictures”,  and  these  in  turn  were  to  be 
contrasted  with  a  more  connectionist  view  as  represented  by  Paul  Rosenbloom 
(or  in  the  language  area  by  David  Touretzky  or  Paul  Smolensky).  The  program 
is  also  appended. 
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Unfortunately,  illness  prevented  many  of  the  connectionists  from  attend¬ 
ing.  This  was  a  serious  loss  which  crippled  discussions  of  such  issues  as  the  role 
of  working  memory,  for  example.  Consequently  most  of  the  discussion  centered 
upon  the  spectrum  of  representations  spanning  pictures  to  sentences.  After  some 
delay  in  defusing  the  obvious  fact  that  all  such  (feasible)  computations  are  Tur¬ 
ing  reducible  and  hence  “symbolic,”  more  attention  was  drawn  to  the  utility 
of  the  form  of  the  representation  in  supporting  particular  tasks.  For  example, 
Levesque’s  definition  of  a  vivid  representation  directly  addresses  this  issue,  with 
the  definition  applying  to  both  the  extreme  iconic  or  sentential  forms.  (How¬ 
ever,  see  Davis’s  concern  where  conclusions  based  upon  partial  information  is 
needed.)  In  many  reasoning  tasks,  logic  is  the  preferred  vehicle,  but  all  logical 
representations  are  not  vivid,  nor  will  all  logics  support  the  human  mental  model 
process,  as  pointed  out  by  Johnson-Laird.  The  utility  of  pictorial  representations 
in  recognition  was  stressed  by  Ullman.  Mackworth  stressed  that  both  symbolic 
and  pictorial  forms  commonly  appear  together,  such  as  in  maps,  diagrams  or 
plans,  and  showed  how  a  logical  model  can  help  to  understand  their  relation¬ 
ships.  Because  logic  was  the  most  universal  language  of  the  group,  the  logical 
form  of  the  various  representations  tended  to  dominate  the  discussions  at  the 
detriment  of  understanding  the  utility  of  the  representation  per  se  with  respect 
to  various  tasks. 

As  the  meeting  progressed,  attention  became  more  focussed  upon  what  kind 
of  computation  a  representation  actually  supported  best,  rather  than  with  the 
logical  content  of  the  representation.  For  example,  Krumhansl  presented  evidence 
for  several  representations  other  than  iconic  or  symbolic  in  the  perception  and 
production  of  music;  Norman  stressed  the  role  of  artifacts  in  the  choice  of  repre¬ 
sentation,  thereby  opening  the  spectrum  of  possibilities  still  further;  Hayes  raised 
the  issue  of  external  versus  internal  representations;  and  Smolensky  attempted 
to  distinguish  between  representations  and  to  show  the  richness  of  possibilities, 
as  did  Philip  Johnson-Laird  in  his  overview  of  “What  is  a  Mental  Model?”  By 
the  end  of  the  meeting,  there  seemed  to  be  a  consensus  that  the  spectrum  of 
representations  is  very  rich  and  that  they  can  be  distinguished  on  many  dimen¬ 
sions.  As  aptly  summarized  by  McDermott,  even  if  one  wishes  to  consider  only 
the  simple  iconic-symbolic  dichotomy,  as  originally  proposed,  then  possible  dis¬ 
tinctions  might  include  “detailed  vs.  non-committal”,  “spatially  vs.  non-spatially 
indexed”,  “intrinsically  vs.  extrinsically”  constrained.  These  distinctions  provoke 
a  reexamination  of  the  utility  of  a  representation  independently  of  its  reduction 
to  a  logical  form.  (See  Johnson  and  Rosenschein,  for  example.) 

In  the  same  spirit,  McDermott  also  attempted  to  distinguish  between  views 
of  “models”  in  reasoning,  recognition,  or  communication.  (See  Pinker  also  for 
distinctions  between  rul>based  and  associative  models.)  Here  the  group  failed 
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to  reach  any  clear  agreement.  Some  members  emphasized  the  cognitive  prop¬ 
erties  of  mental  models,  whereas  others  were  more  concerned  with  the  internal 
data  structures.  Similarly,  some  were  mostly  concerned  with  the  logical  form 
and  content  of  the  mental  process  and  its  definition  (see  Reiter),  as  contrasted 
with  the  actual  computational  machinery  (see  Hopfield,  Jordan  or  Richards  for 
example).  Consensus  was  not  reached  here  simply  because  the  mental  process 
was  being  described  in  quite  different  ways  and  at  quite  different  levels  of  ab¬ 
straction.  Further  study  is  needed  to  examine  how  these  different  descriptions 
may  be  combined  into  a  useful,  integrated  framework.  (See  Peters  and  Kaplan.) 


The  Nature  of  Cognitive  Science 

The  difficulty  the  group  had  in  sharing  a  common  framework  for  “What  is  a 
Mental  Model?”  provides  insight  into  why  some  believe  that  disciplines  within 
the  Cognitive  Sciences  are  tending  to  diverge,  rather  than  to  converge.  These 
sciences  are  not  like  its  sibling  the  Neurosciences,  whose  disciplines  in  the  early 
days  shared  the  common  bond  of  wishing  to  understand  neural  machinery.  Much 
like  the  connectionists  today,  neural  systems  (or  “nets”)  at  that  time  could  be 
viewed  as  machinery  similar  in  principle  across  a  wide  spectrum  of  biological 
systems.  This  is  not  true  of  mental  operations,  where  quite  different  represen¬ 
tations  are  needed  to  support  a  variety  of  cognitive  tasks.  Furthermore,  in  the 
Neurosciences  the  types  of  descriptions  and  levels  of  understanding  desired  were 
similar  -  in  particular,  emphasis  was  placed  upon  mechanisms  and  algorithms 
-  whereas  in  the  Cognitive  Sciences  the  scope  of  desired  descriptions  and  ex¬ 
planations  include  not  only  these,  but  also  the  more  cognitive  operations  and 
conventions  used  to  infer  or  reason  about  a  variety  of  aspects  of  the  world.  This 
spectrum  of  interests  and  descriptions  in  the  Cognitive  Sciences  was  quite  ap¬ 
parent  in  the  dynamics  of  the  meeting.  Because  logic  was  the  language  of  many, 
and  because  the  logical  form  and  completeness  of  a  representation  cuts  across 
many  problems,  the  discussions  tended  to  center  upon  logical  content  and  fa¬ 
vored  those  fluent  in  this  language.  But  this  focus  excluded  explanations  of  the 
mental  process  in  terms  of  its  computational  or  psychological  properties.  Hence 
seldom  did  the  experimental  psychologists  or  connectionists  become  involved, 
and  even  the  linguists  were  largely  silent.  The  reason  in  retrospect  is  clear:  at 
this  meeting  we  chose  a  diverse  group,  with  each  participant  proficient  in  one  of 
three  types  of  representations  (iconic,  sentential,  connectionist)  for  use  in  one  of 
three  problem  areas  (reasoning,  recognition  and  language)  with  interests  in  one 
of  three  levels  of  explanation  (logical  form,  algorithms,  or  psychological  proper¬ 
ties).  We  only  need  to  scan  the  abstracts  to  see  the  wide  diversity  in  viewpoints, 
problems,  and  the  language  or  “tools  ”  used  to  achieve  an  understanding  of  these 
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problems.  “Natural”  grammars  may  be  an  appropriate  vehicle  for  the  linguist 
to  study  language,  but  of  what  use  is  a  grammar  to  the  individual  studying  ob¬ 
ject  recognition  or  iconic  reasoning  when  morphological  operations  or  geometric 
transformations  currently  seem  more  suitable?  Different  cognitive  tasks  create 
different  classes  of  problems  which  generally  require  quite  different  tools  and  ex¬ 
pressions  for  solutions.  Clearly  each  discipline  within  Cognitive  Science  has  its 
own,  quite  different  “Mental  Model.”  The  situation  is  not  at  all  like  the  early 
days  of  the  Neurosciences,  where  everyone’s  ideas  were  reducible  to  the  behavior 
of  neurons. 


Cognitive  Management 

Should  Cognitive  Science  thus  be  resigned  to  accept  a  “divide  and  conquer” 
strategy,  with  each  subdiscipline  studying  its  different  problems  independently, 
with  each  developing  their  own  framework  and  “language”?  Such  a  commit¬ 
ment  might  well  penalize  our  understanding  of  the  essence  of  our  own  mental 
processes.  What  seems  remarkably  clear  is  our  ability  to  flow  so  easily  from 
one  type  of  representation  to  another,  such  as  when  we  move  from  symbols  to 
pictures  as  in  navigation  or  spatial  maps  (Mackworth,  DeJong),  or  when  we 
solve  problems  by  visualizing  our  actions  in  the  world  together  with  simple  log¬ 
ics  (Etchemendy,  Johnson-Laird,  Jepson,  McDermott)  or  perhaps  even  when  we 
learn  a  language  (Johnson,  Webber,  Prince).  In  many  of  these  cases  the  typ  of 
the  representation  (symbolic-iconic)  is  not  the  crucial  issue;  rather  it  is  how  con¬ 
straints  in  the  environment  and  agent-environment  interactions  can  be  exploited 
and  embedded  implicitly  in  the  reasoning  or  perceptual  process,  (See  Levelt,  for 
example.)  Perhaps  at  this  early  juncture  in  our  understanding  of  representa¬ 
tions  in  mental  models,  it  will  be  prudent  not  to  always  focus  too  narrowly  upon 
representational  issues  at  the  exclusion  of  the  management  of  information  flow 
across  representations. 


Whitman  Richards2 
May  1990 
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Final  Program* 


Representations 

Hector  Levesque:  Vivid  Representations 

Shimon  Ullman:  Pictorial  and  Symbolic  Representations 
in  Object  Recognition 

Alan  Mackworth:  Depiction  Theory 
Mental  Models 

Philip  Johnson- Laird:  What  Is  a  Mental  Model? 


“Language”  Understanding 

Carol  Krumhansl:  Internal  Representations  for  Music 

Ronald  Kaplan:  Representational  Transformations 

Paul  Smolensky:  A  Connectionist  View 


Reasoning 

Eric  Sandewall:  Does  Persistence  Occur  Outside  the  Mind 
of  the  Beholder? 

Bernard  Meltzer:  Direct  Representations  of  Naive  Physics 
Donald  Norman:  Cognitive  Artifacts 
John  Etchemendy:  Heterogenous  Reasoning 
Comment :  Willem  Levelt:  Perspective  is  Free 


Issues  -  Recapitulation 
Drew  McDermott 


‘Due  to  illness,  three  connectionists  originally  scheduled  for  presentations  are  omitted 
-  an  unfortunate  bug  in  their  network! 
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3.0  Problem  Statement 


There  is  a  strong  intuition  that  there  are  at  least  two  types  of  representations  in 
cognitive  systems,  one  “Iconic”  based  upon  pictures,  and  the  other  “Symbolic” 
based  upon  links  among  symbols.  (“Distributed,  connectionist”  representations 
might  be  still  another  form.)  Pictures  seem  more  suitable  for  geometric  or  spatial 
reasoning;  whereas  the  symbolic,  language-like  form  is  common  in  language  and 
reasoning  where  quantification  is  important  (for  all  . . .,  there  exists  . . .).  A 
“Mental  Model”  may  use  one  or  both  of  these  forms,  or  perhaps  still  another. 
Although  we  propose  to  examine  the  definitions  and  essential  features  of  these 
alternate  representations,  our  primary  aim  will  be  to  explore  their  roles  in  the 
functioning  of  mental  models.  The  method  we  will  use  to  address  these  issues  will 
be  selected  case  studies  of  mental  models  in  humans  and  artifacts.  (Abstracts  of 
each  participant’s  position  with  respect  to  the  above  follow.) 


E.  Charniak 
P.  Hayes 
M.  Johnson 
S.  Kosslyn 
A.  Mack  worth 
S.  Peters 
R.  Reiter 
D.  Rumelhart* 
D.  Touretzky* 
*  absent 


E.  Davis 
G.  Hinton* 

M.  Jordon 

C.  Krumhansl 

D.  McDermott 
S.  Pinker 

W.  Richards 

E.  Sandewall 
A.  Treisman 


G.  DeJong 
J.J.  Hopfield 

P.  Johnson-Laird 

H.  Levesque 
B.  Meltzer 
A.  Prince 

P.  Rosenbloom* 
G.  Sperling 
S.  Ullman 


J.  Etchemendy 

A.  Jepson* 

R.  Kaplan 
W.  Levelt 
D.  Norman 
Z.  Pylyshyn 

S.  Rosenschein 
P.  Smolensky 

B.  Webber 
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an  understanding  ol  cognition  in  simple  animals  And  it  is  difficult  to  believe  that 
higher  animals  will  be  easier  in  this  regard 
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These  difficulties  have  caused  researchers  to  turn  to  an  alternative  theory,  the  theory 
of  mental  models  This  theory  posits  that  when  a  conclusion  is  to  be  drawn  trom 
premises,  the  first  step  is  to  construct  a  detailed  representation  of  a  particular 
situation  satisfying  the  premises  Then  the  question  is  answered  by  inspecting  this 
"model  ”  In  some  cases,  more  than  one  model  gets  constructed.  In  the  example 
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McCarthy's  predicate  circumscription 
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Does  Persistence  Occur  Outside  the  Mind  of  the  Beholder?  If  the  latter  viewpoint  is  adopted,  then  ii  becomes  very  meaningful  to  relate 

investigations  into  the  "natural"  design  ot  perceptors,  to  investigations  ot  actually 
Erik  Sandewall  occurring,  conceptual  knowledge  structures 


?o° 

9  £  > 

i~S 

5^-6 

5  _y  « 

ii  i«5 

«  ®  3 
«  ®  -o 

n  ®  c 

®  -O 
p  c  £ 

1st 

'  X 

j  ©  ®  to 
O  ® 

C  s 

«  ®  = 

J  j:  w  E 
J  JO  C 

?'?  &§ 

2  re  >.■>- 
:  P  «  ° 
o  -  —  c 

3  ®  <  9 

1  c  •  ®  — L. 

5  9  n  tt  tn 
3  «  c  p  oo 

k  «  5  c  < 

3  o  re _ — - 

2  -  *”  re  -o 

D  2  ®  9  e 

:  2  £  o)  re 

3  0  ^ 

2  f  £ 

:  -.2  c  u  5 
o  o  « 

S£  *  ®  s. 

>n  f  2. 

;  o  .15  c 
2  c  c  ^ 
:  fljr  aE 


lit 

®^s 

^  ©  ° 
tO  -  ? 

Isf 

re  ®^ 
.n  c  m 
•r  © 

*  f.s 

X5  to  c 
®  ©  o 

03  Q.  tO 

to  S  ® 
3  O  -o 
=  JZ 

to  C  c 

•  J  gi 

%  -C  © 
g^vi-o 

1-2 

1*3 

■g  *“  c 

O  J  >* 
O  N  i 

®  c  ® 

«  OI> 

IK 


re  £  § 

CO  ® 

&|8 

i  £ 

isl 

?!  s 

.9  £  in 

fit 

>*  rr 

®  g  ® 

o  E  5 

«ll 

® 

£  *  a. 
o|^ 

l?l  ■ 
*  8-2 
re  ®  £ 

£  01 
© 

<5  -C  - 
_  —  ® 

CD  cl 
C  ©  q 

®£  a 

©  ^5  © 

lo¬ 

ll* 

5.S? 

£  re  « 

3  S2  ® 

C.  .t;  ~r  m 

8  2  5 1 

©  C  c 
.Q  rc  j* 


5  0  3 
>  ~  to 

C  ®  c 
®  ^  « 

8*  8 
C  C 
CO® 

®  o  ® 


4  Ii 
s  11 


r>  w  •  — 

^  ®  > 

t*£ 
*£§ 
9  in  CD 

1  ®  ^ 
o  m  £ 

>.£  | 
c  Cl  2 

re  £  o 

ii  « 
o  ®® 

“  si 

Q.  © 

o  a.  -C 

|  re  I 

II! 

i*l 

to  c 
O  ®  "O 
*•  c  c 

OJ  o  © 

c  ®  . 

c  £  c 
E  o 

8  J  a 

9.0® 

15  ® 

2  3  CL 
2  <=>-£ 
SEa 
*  o  ® 

-  OT3 


5  c  — 

>  a  o 
c  E  ® 

-<  i 

■A  3 

if" 
©  © 
C  t)r 
to  c  *" 
|  «  o 

£  g£ 

c  tfl  oi 
$  ®  3 
®  O 

if- 1 

®  re  2 

E|3 

§  c  >» 

®Sf 
e  ■  g 

o 

£  ^  X: 
to  5  3 
>  to 

o  ®  c 

£  jt  ® 

3  2  © 
®  C  - 
££  ? 

*1.® 
no® 
c  o  > 
re  ®  re 

2"  E  - 
o  ® 

|  s  ® 

E  ® 
no 

EC  O) 

re  o 

■5^3 
c  y  c 
■2  g  9> 

to  to  (/) 


©  rr  ©  © 

f  ®  ®  9- 
to  E  E 

3  C  3  ® 

E  2S  £ 

n  c  o  o 

^  ®  jr  — 
O  V) 

i  £  -  P 
—  —  F- 

®  3  £  3 
X  in  « 

|  re  §  J 
■E  9  2  2 

*2  re  9  3 
ti  P  -p  ° 
®  X  ®-o 

■a  £  >  c 

c  c  c  — 
re  -  o  ® 

«  ®  °  i 
a .? 

eh  ®  * 

-c  g- ®  ~ 
“  f  »  c 
E  2  o  ® 

»  £  C  O 
c»  «  je  .« 
®  ®  ®  £ 
<"  >  >  E 
o  re  re  2 

ilif 

o  o  u  re 

3  c.  «  £ 

;sf  b 

.=  >  ®  p 

®  *  «  £ 
-3.  —  r  u, 

c  re  _  _ 
~  ®  5  re 
5^93 

t  Q  A 

S  re  g- 


S  "8 


to  to 
:<n  ®  re  ® 

T3^  o  3 
®  o 

-o  jz  6  2 

9  H  ^  w 
•  ^  o 

rt  O  ®  ^ 

||H 

£  -o  e  £ 
in  O  S 
c  a-  in 
O  O  «  re 
o  .  re 

?  ®  J§  a 
«  £  >>E 

m  q.  g  m 

S-2  E  l. 

®  a  m  o 

c:  £  . 

87:  3  in 

#tj« 

®  2  2  3 
3  ®  to  E 
a.—  o 

o 

lf§f 

i!8£ 

“l^re 

®  .  —  c 
0>:  —  O 

®  in  O  s  ® 

?I  ®f  re 
•2  ®  re  2  o 

3  in  o-c 

c  o  re  re  £ 

sSjy 


®  -o  >, 
^  c 

—  ro  o 
o  -  ® 

—  <0  .c 
o>  y  I! 
c  to  p 

-£  c  ® 

8  a£ 

o  rer  o. 

*  o  8 

®  2  § 
n  re  0 
c  «£ 
re  >,  o 

-o 

X  re  ^ 
0  u  P 
®  ®  2 
a  a-  n 

in  3-  o 

E,8| 

S,re  ® 

fi® 

*  £  ® 
o  re  > 
c  £  « 
jc  to 

II  § 

«  -  to 

tr  C» 

re  ^  ~ 

3  2  p 

a.E  i 

®  CR  ® 
-C  c  ® 
*"  ®  c 

is? 

w  W  _ 

©  ^  o 
®  JS  ^ 
o  o  c 

=vo8 

©  to  o 
3  ®  ;= 

?1-E 

v,g| 

■“*  C  3 

s  a  © 


©  ©  © 

E  3  ®  g 
to  ■=  c  .9 

“  2  g-re 

2  ®  X  c 
£  c  o  ® 

_  L_  “•  lO 

in  .  ®  ® 

o  a 

1  ®  £  v> 
™-0n£ 

«  |  S  c 

©to  - 

I;-#® 

*r  CJ>  -5  -q 

|  ®  of 

_  O  © 
®  C  Tm  XZ 

£*  S~ 

n  re '«  i3 

£  ■*  c  Q- 
"2,0.0 

® 

©  -0  ©  •- 
S  c  —  a> 
®  ®  ®  is 

3  is  £  " 

O’  -pr  . 

u  3  Ja 

ffi  *r  ®  - 

S  Q.  O  -C 
p:  ®  c  to 
_  O  0  c 
£  c  o  o 
®  o  ^ 
®  0  c  re 

2  c  8  2 

sl^£ 

■c  -0  9-  ? 
c  c  c.  = 

O  <fl-° 

(A  f  c  h 

n?  9  8 

®  —  re  ® 
®  2  ®2 

So 

r®N 

w  Z  re 
re  o  i 


re  c  ® 
®  ®  . 

"2  3- 
c  ®  §■ 
©  >  c 

®  ®  to 
to  n  ^ 

to  ®  ’ 

©  ©  CD 

^  ® 
^  T3  > 

®  3  *  • 

E  £  g 

to  b 
<0  -* 
©  ®  —  : 

O)  ® 
3D  3’ 
Tj  ®  Q, 
?  }  # 
in  8  a 

®5f 

?  3p 
S  >•  o . 
cd 

B  I  8 

to  £  ® 

®  Z  £ 

Hi 

iff. 

_  «  o 
in  ®  in 
O  >  c 

£  re  o 

c  ®  5  ■ 
®  *  c  ■ 

*  i  in 
Son 
Jn  o  • 

.0  E 

c  8^' 

2  £n 

l||. 

n  ®  2 
_  m  « 
®  c  > 
no® 
t-  o  n  . 


gc  S 

0  2 

re  «  2  f 

Hi  2- 

s  ®  *  — 

-o  £  ®  £ 

O  ®  JC  r 

to  £ 

Eo°  1 

2  in  * 

;  =  9  S2 

2  °  re  ®  ' 

§■  5  i  3 

*  0  ®  in  . 

?« 

5  in  -O  01 

•S  n  o  c 


®  P 

•o  0.2 
®  E  ® 
>  re  E 
re  x  o 
n  ®  in 


statements  about  the  world,  and  should  be  compared  side  by  side  implied  mental  representations  as  opposed  to  their  functional  properties  because,  it 

seemed  to  me,  that  many  different  representations  might  share  similar  properties  It's 
2)  Physical  knowledge  describes  the  world  directly;  conceptual  knowledge  uses  the  rules  that  determine  the  game,  not  the  uniforms  of  the  players  But,  I  would  be 

structures  which  are  natural  in  the  output  from  perceptors  ot  the  world  coming  to  the  workshop  to  be  educated;  hopefully  it’s  not  too  late 
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4.0  Mental  Models  Meeting:  Evaluation  Summary* 

Using  a  questionaire  handed  out  to  all  participants,  the  meeting  was  evaluated 
in  five  categories: 

1.  Quality  of  meeting 

2.  Degree  of  cross-discipline  communication 

3.  Scientific  value 

4.  Potential  impact  on  Future  Research 

5.  Cost  effectiveness 


1.  Quality  and  Uniqueness  of  Meeting 

The  aim  was  to  provide  an  intense,  high-level  interaction  and  exchange  not  read¬ 
ily  available  in  present  meetings  or  workshops. 


Percentile  (Median)  Range 

a)  In  comparison  with  other  workshops  or  satellite  80  40-95 

meetings  in  the  fields  of  Cognitive  Science,  Linguis¬ 
tics,  AI,  or  Experimental  Psychology',  in  what  per¬ 
centile  does  this  Study-Session  fall  with  regard  to  the 

intellectual  content  and  discussion  level? 

b)  Was  the  intellectual  level  of  the  meeting  set  solely  Particpants  80%  n/a 

by  the  stature  of  the  participants,  or  did  the  format 

and  topic  flow  provide  an  important  role? 

c)  Was  there  a  sense  that  the  participants  experi-  75  60-90 

enced  a  meeting  environment  different  from  that  cur¬ 
rently  available  to  them? 


d)  Were  the  subfields  adequately  represented?  W’hich  OK,  except  connectionists 

might  be  strengthened? 


2.  Degree  of  Cross-Discipline  Communication 

One  of  the  major  goals  of  the  proposal  for  similar  interdisciplinary  meetings  is 
to  foster  communication  between  disciplines  that  otherwise  would  not  interact. 
To  what  degree  was  this  meeting  successful  in  this  regard? 


Percentile  (Median) 

Range 

a)  What  percent  of  the  participants  knew  one  an¬ 
other  or  had  read  a  paper  of  the  participant? 

50 

30-90 

b)  Did  discussions  occur  across  disciplines  rather  than 
within? 

across:  50% 

n/a 

c)  Were  there  profitable  or  unexpected  interactions 
between  disciplines  during  the  breaks,  at  meals  or 
“after  hours”? 

30  (Too  few) 

n/a 

d)  Were  there  indications  that  some  participants  were 
alerted  to  work  or  ideas  they  otherwise  would  have 
been  ignorant  of,  or,  that  after  departing,  would  read 
a  paper  that  they  otherwise  would  not? 

70 

10-80 

e)  Did  the  speakers  make  an  effort  to  describe  their 
subjects  in  a  way  different  from  what  they  would 
choose  to  address  an  audience  from  their  own  disci¬ 
pline? 

40 

30-70 

f)  Did  the  speakers  respond  well  to  questions  from 
individuals  outside  their  discipline? 

3.  Scientific  Value 

50 

50-75 

A  successful  interdisciplinary  meeting  should  be  able  to  report  a  new  result 

or  an 

advance  in  the  field  as  a  whole,  as  well  as  advancing  each  individual’s  knowledge. 

Percentile  (Median) 

Range 

a)  Did  the  meeting  add  any  knowledge  to  the  field? 
Did  the  discussions  and  exchanges  lead  to  an  insight, 
partial  solution,  or  hint  toward  a  solution  not  previ¬ 
ously  available  to  the  scientific  community? 

60 

10-80 

b)  Was  there  a  consensus  among  the  participants 
that  they  each  learned  something  of  value  they  oth- 

30 

10-50 

erwise  might  have  missed? 


4.  Potential  Impact  on  Future  Research 


Percentile  (Median)  Range 


This  issue  interacts  with  Scientific  Value.  If  there 
is  a  communal  advance  in  knowledge,  then  the  sig¬ 
nificance  of  this  advance  can  provide  a  crude  mea¬ 
sure  of  impact.  For  an  individual,  however,  the  key 
question  is:  was  a  participant’s  research  direction  al¬ 
tered  by  the  meeting?  If  so,  was  it  a  major  change, 
a  mid-course  correction,  or  simply  an  inclusion  that 
otherwise  might  not  have  taken  place? 


50 

(mostly  minor 
changes  in 
direction) 


0-80 


5.  Cost  Effectiveness 

Are  the  benefits  of  such  interdisciplinary  meetings  worth  reallocation  of  present 
funds,  either  those  of  the  researcher  or  of  the  supporting  agencies,  or  both? 

Percentile  (Median)  Range 

a)  What  percent  of  currently  attended  meetings  yield  20  5-25 

the  same  impact  upon  a  participant’s  research  as  this 

meeting  did? 

b)  What  is  the  estimated  lead  time  for  participants  6  months  -  1  year 

whose  research  was  impacted? 


6.  Summary 

Although  there  was  general  agreement  that  the  quality  of  the  meeting  was  quite 
high  for  everyone  (top  80%),  there  were  very  significant  differences  among  in¬ 
dividuals  in  the  impact  the  meeting  had  upon  their  perspectives  and  research. 
Similarly,  there  were  marked  individual  differences  in  benefitting  from  the  inter¬ 
disciplinary  backgrounds  of  the  participants.  Reasons  for  the  failures  to  better 
communicate  across  disciplines  are  discussed  in  the  body  of  the  report. 


Compilation  based  on  25%  responses  to  formal  survey,  plus  informal  responses. 
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